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(57) Abstract 

A method and apparatus for creating threshold arrays having a minimized gray 
scale variance without geometric artifacts. The invention comprises the steps of 
processing each candidate pixel in the threshold array using a variance minimization 
technkjue and applying a sparse image calculation on the same pixel. The preferred 
embodiment of die invention comprises the application of a variance minimization 
technique on a threshold array. The threshold array is analyzed on a raxeWry-pixel 
basis. Each candidate pixel mat is to be turned on is examined in relation to the previous 
pixels mat already exist. The candidate pixel it examined to determine its effect on 
the variance of the smoothed gray level determined by the convolution of the pixel 
pattern wim a smoothing kernel. The candidate pixel is afaso examined in relation to 
the distribution of me angles it forms with the previously selected pixels. The preferred 
embodiment uses a variant of the combinatorial Hough transform. In the preferred 
embodiment, mere is an accumulator array for each not yer selected pixel mat has a 
location for each of a quantified set of angles. A sum is stored in this location based 
on those previously Selected pixels which make an angle with the not yer selected pixel 
which is disc retired to the angle corresponding to that location. The effect of the true 
angle may be distributed oyct more than one location of the accumulator array and may 
depend on distance and angle. Ic is desired that a pixel is selected which combines a 
low variance of the smoothed gray level with a favorable disrribuiion of values in its 
angle accumulator array. This process is repeated until all the pixels in the threshold 
array have been selected, 
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METHOD AND APPARATUS FOR PRODUCING 
THRESHOLD ARRAYS USING VARIANCE MINIMIZATION 
AND PEXEL ANGLE CALCULATIONS 

PAckCrROUNP OF THE INVENTION 



TECHNICAL FIELD 



10 The invention relajies 10 digital halftoning. More particularly, ihe invention 

relates to the production pf threshold arrays in the digital halftoning process using 
filtering and sparse imag^ techniques, resulting in minimal gray scale variance and 
geometric artifacts. 



15 



DESCRIPTION OF THE PRIOR ART 



I 

Threshold arrays qre an important component in displaying or printing digital 
image data. The digital injage data must be transformed or processed so that computer 
display terminals with various grey level capacities, laser printers, dot matrix printers 
20 and inkjet printers, many |having different resolutions and aspect ratios, all render an 
image represented by the jmage data in a similar way. An image processor associated 
with or configured for each such output device transforms the digital data to a form 
tailored to the characteristics of that particular device. 

Digital halftoning) is a key function of such a processor. Halftoning is the 
25 process that approximates! continuous tone colors (or gray scale) by a pattern of pixels 
that can achieve only a limited number of discrete colors or gray levels. The most 
familiar case of this is the rendering of gray tones with black and white pixels. 

There are two clashes of ordered dither halftoning techniques known in the art. 
They are clustered-dot and dispersed-dot ordered dithering. Clustered-dot ordered 
dithering uses variable-si^e halftone dots at a fixed spacing. The addition of device 
pixels at a dot's outer ed^e increases the covered area and the size of the dot. When 
viewed from a distance, the larger the dot size, the greater the area covered and the 
darker the image area. Dppersed-dot ordered dithering is preferred when the display 
device is capable of displaying an isolated black or white pixel. It uses a fixed-size, 
35 smaller dot at variable spacing to achieve the same effect as clustered-dot ordered 
dithering. Variation in dot spacing varies the number of dots in a given area, or dot 
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frequency. In such technique, a denser doi distribution provides a darker image area. 
On some display devices, each dot comprises up to four or five device pixels. 
Dispersed-dot ordering provides a dot distribution based upon the shade variations in 
the original image. The dot distribution is optimized to be the best representation 
5 possible for the particular display device. 

Ordered dithering is generally implemented using a threshold array, also known 
as a dither matrix. Typicalfy, each element in the threshold array represents a dither 
threshold value and is mappjed through a Cartesian coordinate system to pixel locations 
on the continuous tone original and on the output medium. Ordered dither algorithms 
10 generate binary halftone imps by comparing reflected light from pixels of an original 
continuous tone image to corresponding threshold values stored as elements in the 

threshold array. ! 

A threshold array is used to directly control the individual pixels in a halftone 
image. A threshold array J much like a sampled image because it is a rectangular array 
15 of pixel values. However, it is defined entirely in device space, and the sampled values 
typically occupy 8 bits each. Each element within the threshold array is assigned a 
threshold value which represents the tonal value at which the pixel is turned on. When 
deciding whether to turn thk pixel on. an image processor checks the pixel's location in 
the halftone image, determines the tonal value of the image at that exact location, and 
compares this tonal value jrith the pixel's threshold value in the threshold array. If the 
tonal value exceeds the threshold value, the pixel is turned on when the image is created 
by the imaging system. The effect of the distribution of black and white over the 
display image is integrated by the human eye as gray. 

k would require a very large memory to store the threshold array for a screen 
25 large enough to be superimposed on an entire original image. Therefore, it is not 
uncommon for a threshold array to be replicated and tiled over the entire device space. 
Each pixel of device spatje is mapped to a particular element of the threshold array. 
Only one copy of the threshold array need be stored. Threshold values stored in this 
fashion are usually mapped to pixel locations on the continuous tone original through a 
30 Cartesian coordinate system, modulo the dimensions of the repeating array. 

Halftoning with a particular homogeneous threshold array has become known 
as a "Bayer matrix." A Bayer matrix is an optimally homogeneous ordered threshold 
array. The goal in generating a threshold array is to order the samples so that, as each 
successive position or point is turned on. the total two-dimensional ensemble of "on" 
35 points remains as homogeneously arranged as possible for each gray level to be 
simulated- However, the homogeneous arrangement of a Bayer matrix creates a regular 
geometric pattern that is visible in the display image. 
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U.S. Pat. No. 5,317.418 issued to Lin on 31 May, 1994, is a method for 
generating a halftone image from a gray scale image by means of a dither matrix. The 
matrix contains many patterns, each of which represem one gray level of the gray scale 
image. A positive filter is yscd to create the patterns in the matrix. The value of each 
5 pixel in the gray scale image is compared to the value of an element in the dither matrix, 
as described above. 

Threshold arrays are also used in U.S. Pat. No. 5,542,029 issued to Karlsson 
on 30 July, 1996. The method involves the uses of overlapping threshold arrays rather 
than tiled threshold artays to reduce the required size of the repeating threshold array. 

10 Dispersed-doi ordeiied dithering presents problems, however, in that the amount 

of gray within an original image is not maintained over an area, Le. the error arising 
from the difference between the threshold value and the actual gray level value at any 
particular cell is simply ttjrown away. This results in a loss of image information. 
Halftoning also introduces' patterns, anomalies, or coarse quantization artifacts which 

15 are visible in the image ajreas where the scene has little variation (also known as 
banding). j 

A technique known] as error diffusion is used in the art and makes implicit use 
of an eye model. It shapesjthe noise, Le. the difference between the gray scale image 
and the halftone image, so that it is not visible by the eye. The error diffusion technique 

20 produces noise with most of the noise energy concentrated in the high frequencies, Le. , 
so-called blue noise. Thus^ it minimizes the low-frequency artifacts. However, since 
error diffusion does not majce explicit use of the eye model, it is not easy to adjust when 
the eye filter changes, for example, with printer resolution or viewer distance. It does 
accomplish good resolution! by spreading the dots. 

25 An example of blue noise masking techniques is demonstrated by U.S. Pat. No. 

5,543,941 issued to Parkejr et a!, on 6 August. 1996. It describes a technique for 
rendering a halftone imap of a gray scale image by utilizing a pixel-by-pixel 
comparison of the gray scaje image against a blue noise mask. The gray scale image is 
scanned in on a pixel-by-pi^tel basis and compared on a pixel-by-pixel basis to an array 

30 of corresponding data points contained in a blue noise mask stored in an array in PROM 
or computer memory to produce the desired halftone image. 

U.S. Pat. No. 4,339^774 issued to Temple on 13 July, 1982, implements error 
diffusion in generating a cjispersed dot halftone image from a continuous tone input 
image. Error diffusion is also used in U.S. Pat. No. 5,321,525 issued to Hains on 14 

35 July, 1994, to create well-formed printable dots in a clustered dot halftone image. 

Eye modeling is used to create a diagonal correlation dither matrix in U.S. Pat. 
No. 5,526,438 issued to Barton on 1! June, 1996. The matrix forces diagonal 
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correlation of adjacent dots in the output image. The desired result is a masking of any 
artifacts through the favoring of diagonal pixels over horizontal or vertical pixels in an 
effort to produce visually unobtrusive output dot patterns. 

In the same manner! U.S. Pat. No, 5,124.803 issued to Troxel on 23 June, 
1992, uses angled, overlapping screen tiles to create a halftone image- The angled 
screen tile boundaries are generated in response to selected integers which, together 
with the number of screen djois along a side of the tile in the direction of screen pitch 
measurement, determine ihellimit of the magnitude of screen angle error. This method 
minimizes moire patterning ip the resulting digital halftone color image. 

U.S. Pat. No. 5,422,742 issued to Ostromoukhov et al. on 6 June, 1995, is a 
method and apparatus for automatic high-speed generation of digital angled halftone 
screens. A scanning dithei array is introduced which is used for obtaining screens 
approximating the irrational angles which are generally required by bigh-quaiity color 
reproduction. The method enables color separations to be generated which minimize 
moire effects, interferences, [and artifacts. 

Error diffusion and ^n eye model are utilized in U.S. Pat. No. 5,469,268 issued 
to Neuhoff ei al. on 21 November, 1995, to create a halftone image corresponding to 
gray scale input image. An bptimized halftone image is produced by finding the binary 
image that causes a combination of printer and visual models to match the output of the 
visual model in response to the original gray scale image. 

The aforementioned prior art methods attempt to mask the presence of artifacts 
in the resulting halftone display image. However the actual artifacts are still present, 
but may be less evident) to the human eye at certain distances or resolutions. 
Nevertheless, the artifacts still exist It would be highly, desirable to be able to create a 
halftone image without the presence of artifacts. 

gTIMMARV OF TH E INVENTION 



The invention provides a method and apparatus for creating threshold arrays 
having a minimized gray scale variance without geometric artifacts. The invention 
comprises the steps of processing each candidate pixel in the threshold array using a 
variance minimization tec urique and applying a pixel angle calculation on the same 
pixel. 

The preferred embodiment of the invention comprises the application of a 
variance minimization technique on a threshold anay. The threshold array is analyzed 
on a pixel-by-pixel basis. jEach candidate pixel that is to be turned on is examined in 
relation to the previous pixels that already exist. The candidate pixel is examined to 
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determine its effect on the variance of the smoothed gray level determined by the 
convolution of the pixel pattern with a smoothing kernel. The candidate pixel is also 
examined in relation to the distribution of the angles it forms with the previously 
selected pixels. The preferred embodiment uses a variant of the combinatorial Hough 

transform. i 

In the preferred embodiment, there is an accumulator array for each not yet 
selected pixel that has a location for each of a quantized set of angles. A sum is stored 
in this location based on those previously selected pixels which make an angle with the 
not yet selected pixel which is discretized to the angle corresponding to that location. 
The effect of the true angle may be distributed over more than one location of the 
accumulator array and may depend on distance and angle. It is desired that a pixel is 
selected which combines a low variance of the smoothed gray level with a favorable 
distribution of values in its angle accumulator array. This process is repeated until all 



the pixels in the threshold array have been selected. 

ttttTFF INSCRIPTION OF THE DRAWINGS 
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35 



Fig. 1 is an illustration of a threshold array according to the invention; 

Fig. 2 is an illustration of a threshold array tiled over a device space according 

to the invention; 

Fig. 3 is an illustration of an image according to the invention; 

Fig. 4 is a data flow diagram of a candidate pixel evaluation according to the 
invention; 

Fig. 5 is an illustration of a candidate pixel in relation to the distribution of 
angles it forms with a previously selected pixel according to the invention; 

Fig. 6 is a illustration of an accumulator for a pixel P is according to the 
invention; and 

Fig. 7 is an illustration showing a candidate pixel within a threshold array being 
periodically tiled according to the invention. 

^TAILED DESCRIPTION OF THE INVENTION 



The invention 
having a minimized gray 
comprises the steps of 
variance minimization 
pixel. 



provides a method and apparatus for creating threshold arrays 
scale variance without geometric artifacts. The invention 
prpcessing each candidate pixel in the threshold array using a 
technique and applying a pixel angle calculation on the same 
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The preferred embodiment of the invention comprises the application of a 
variance minimizaiion technique on a threshold array. The threshold array is analyzed 
on a pixel-by-pixel basis. Each candidate pixel that is to be turned on is examined in 
relation to the previous pixels that already exist. The candidate pixel is examined to 
5 determine its effect on the variance of the smoothed gray level determined by the 
convolution of the pixel pattern with a smoothing kernel. The candidate pixel is also 
examined in relation to the| distribution of the angles it forms with the previously 
selected pixels. The preferred embodiment uses a variance of the combinatorial Hough 
transform. 

10 In the preferred embodiment, there is an accumulator array for each not yet 

selected pixel that has a location for each of a quantized set of angles. A sum is stored 
in this location based on thoje previously selected pixels which make an angle with the 
not yet selected pixel whichj is discretized to the angle corresponding to that location. 
The effect of the true anglj may be distributed over more than one location of the 
15 accumulator array and may jdepend on distance and angle. It is desired that a pixel is 
selected which combines a jlow variance of the smoothed gray level with a favorable 
distribution of values in its jingle accumulator array. This process is repeated until all 
the pixels in the threshold array have been selected. 

Referring to Figs. 1 and 2, a threshold array 101 is shown as an array of 
20 numerical values 102. The lvalues typically occupy eight bits each and range from 1 to 
255, although any desired values may be used. The threshold array 202 is typically 
replicated and tiled over thj entire device space 201, e.g. the surface of a display or a 
recording medium, such aj paper. Each pixel of device space 201 is mapped to a 
particular element of the threshold array 202. 
25 Turning to Figs, ljand 3. when deciding whether to turn the pixel on, the 

pixel's locauon 302 in the halftone image 301 is checked by determining the tonal value 
of the image at that exact locauon, which is then compared with the pixel's threshold 
value 102 in the threshold irray 101. If the tonal value exceeds or equals the threshold 
value, the pixel is turned on; when the image is created by the imaging system. 
30 The invention operates during the creation of the threshold array. It examines 

each pixel that is a candidate to be turned on. Each location in this threshold array may 
be thought of as a pixel. The value at the location represents the order in which a 
corresponding pixel is to be turned on. 

In the invention, a: smoothing kernel K is used to determine a function G i j 
35 which approximates a per:eived gray level for the desired gray level. The resultant 
equation is: 
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■Variance 
Let 

G(i,j):= 3 3 b p . q K<(i-p)^ N ,0-q>^ N ) 



Var: = 3 3 (G(p,q)-G)- 

P q 



PCT/U S98/2 1009 



K is smoothing kernel, forjexample K(i,j) = e 



bp* = 1 if previously selected pixel or candidate pixel; 
O otherwise; 

G = average value of G(ij). 

Let Var L| = Var where the candidate pixel is at location (i, j) 
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The smoothing is doubly periodic. 

Typically the parameter in k of K is adjusted io provide more smoothing when 

ihe minority pixels are funhen apart. 

Fig. 4 is dataflow diagram of a candidate pixel evaluation according to the 
invention. The candidate listj ( 100) consists of all pixels within a threshold array. The 
order of pixels is equal to 0 ( 1 10). While the candidate pixel list is not empty (120), for 
each candidate pixel Pj: 



Determine the varianc e (P t ) (130); 

Determine the Hough value (P s ) (e.g. Pixel coUinearity) (140); 
Make the penalty mjuch the variance plus I times Hough value, where 1 is a 
subjectively selected parameter (150); 
Select the Pj that has minimal penalty P* (160); 
Remove P* ftom the candidate pixel list (170); 
Make the order of P" equal to the order (180); and 
Make the order = order +1 (190). 

Fig. 5 is an illustration of a candidate pixel in relation to the distribution of 
angles it forms with the previously selected pixel according to the invention. In Fig. 5, 
a previously selected pixel Q is shown as well as a not yet selected pixel Py. 

Fig. 6 an illustration of accumulator 60 for a pixel ? i} according to the 
invention. There is an accumulator array for each not yet selected pixel (Fig. 5) that has 
a location for each of a quantized set of angles [I] [j] [k]. The accumulator for pixel F u 
stores a sum based on those previously selected pixels which make an angle with the 
not yet selected pixel whicli is discretized to the angle corresponding to that location. 
Thus, Q (Fig. 5) contributes a value to the sum stored in the accumulator. It should be 
noted that the angles shown in Fig- 5 correspond to those shown in the accumulator of 
Fig. 6. 

Fig. 7 is an illustration showing a candidate pixel within a threshold array being 
periodically tiled according to the invention. When a point Q is selected, four points 
(e.g., Q 0 , Qi. Q 2 > Q3) are psed to represent the relationship between Q and Py, where 
Py is a not yet a selected point. These four points are the closest for periodic repeats of 



Q nearest to P^. It can be 
fact that the angle between 



seen from Fig. 7. that the invention takes into account the 
the candidate pixel and the previously selected pixel may be 



35 distributed over more than one location of the accumulator array and may depend on 
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both distance and angle* For each poini Qj ii = 0,1,2.3), the values in the locations of 
the accumulate array are increased based on the angle and distance between Q i and P r 
The Hough penalry is a measure of how previously selected pixels line up with P^. In 
the present embodiment, the values in the accumulator array are averaged two at a time 
(periodically) and the maxinpum of the averaged values is used. It is desired that a pixel 
he selected which combines a low variance of the smooth gray level with a favorable 
distribution values in its anj»le accumulator array. As set forth in connection with Fig. 
4, this process is repeated with all pixels in a threshold array until all pixels in the 
threshold array have been selected. 

Although ihe invention is described herein with reference to the preferred 
embodiment, one skilled in t^he art will readily appreciate that other applications may be 
substituted for those set forth herein without departing from the spirit and scope of the 
present invention. For example, although the invention is described as applying to an 
8-bit gray scale, one skilled in the art can readily appreciate that these functions may 
applied to image data larger than 8 bits. Accordingly, the invention should only be 
limited by the Claims included below. 
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I . Method for producing a threshold array, comprising ihe steps of: 



means for selecting a 



candidate pixel to be turned on in the threshold array; 



level; 



selecting a function representing the perceived binary pattern for a desired gray 
applying said binary 



function to said candidate pixel and all existing pixels in 
said threshold array to determine a variance between the value of each perceived pixel 
10 minus the average of all existing pixels; 

applying a pixel anlgle function to said candidate pixels and all previously 
selected pixels in said threshold array to determine a measure of collinearity with any 
other existing pixels; and I 

turning said candidate pixel on if the sum of the variance and 1 times the 
15 collinearity measure for saidj pixel is minimized, where 1 is a parameter- 

i 

2 * An apparatus for producing a threshold array, comprising: 

means for selecting I candidate pixel to be turned on in the threshold array; 
means for selecting a function representing the perceived binary pattern for a 

20 desired gray level; 

means for applying said binary function to said candidate pixel and all existing 
pixels in said threshold array to determine a variance between the value of each 
perceived pixel minus the average of all existing pixels; 

means for applying a pixel angle function to said candidate pixels and all 
25 previously selected pixels ip said threshold array to determine a measure of collinearity 
with any other existing pixels; and 

means for turning skid candidate pixel on if the sum of the variance and 1 times 
the collinearity measure foi said pixel is minimized, where 1 is a parameter. 

30 3 . A method for creating a threshold array having a minimized gray scale variance, 
comprising the steps of: 

processing each of a plurality of candidate pixels in said threshold array using a 
variance minimization technique; and 

applying a pixel angle calculation on said candidate pixel. 

35 I 

4 . The method of Claim 3 further comprising the step of: 

analyzing each pixeJ in said threshold array on a pixel by pixel basis, 

10 
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5. The process of Clajim 3 wherein said candidate pixel is examined to determine 
its effect on the variance ofj a smoorh gray level determined by the convolution of a pixel 
pattern with a smoothing kpme). 

5 ! 

6. The method of Clayn 3 wherein said candidate pixel is examined in relation to a 
distribution of angles it forpns with previously selected pixels. 

i 
i 

7. The method of Claim 6 wherein said distribution of angles is determined using a 
10 variant combinational Hough transform. 

8 . The method of Claim 3 further comprising the step of: 

providing an accinrjulator array for each not-yet-selected pixel that has a location 
for each of a quantized set jaf angles. 



15 



20 



T 



9, The method of Claim 8 further comprising the step of storing a sum in said 
accumulator array location based on those previously selected pixels which make an 
angle with said not-yet-self cted pixel, wherein said not-yet-selected pixel is discretized 
to an angle corresponding tjo that location. 

10. The method Claim 9 wherein an effect of a true angle may be distributed over 
more than one location of |said accumulator array and may depend upon distance and 
angle* 

25 11. The method of Clflim 3 wherein a pixel is selected which combines a low 
variance of a smooth gray level with a favorable distribution of values in an angle 
accumulator array. 

12. A apparatus for cheating a threshold array having a minimized gray scale 
30 variance, comprising: » 

a threshold array irj which each of a plurality of candidate pixels is pressed 
using a variance minimization technique; and 

means for applying a pixel angle calculation on said candidate pixel, 

i 

35 13, The apparatus of Clkim 1 2. further comprising; 

mean for analyzing Jeach pixel in said threshold array on a pixel by pixel basts. 



II 



i 
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14. The apparatus of 
determine its effect on the 
convolution of a pixel pattern 



PCT/U598/21009 



Cl^im 12 wherein said candidate pixel is examined to 
variance of a smooth gray level determined by the 
ivith a smoothing kemeL 



15. The apparatus of Claim 12 wherein said candidate pixel is examined in relation 
to a distribution of angles it forms with previously selected pixels. 

16. The apparatus of Clajm 15 wherein said distribution of angles is determined 
using a variant combinational jHough transform. 

i 

17. The apparatus of Claim 1 2 further comprising: 

providing an accumulator array for each not-yet-selected pixel that has a location 
for each of a quantized set of jangles. 

18. The apparatus of Clajm 17 wherein a sum is stored in said accumulator array 
location based on those previously selected pixels which make an angle with said not- 
yet-selected pixel, wherein! said not-yet-seiected pixel is discretized to an angle 
corresponding to that location. 



20 19. The apparatus Claim! 18 wherein an effect of a true angle may be distributed 



over more than one location 
and angle. 



of said accumulator array and may depend upon distance 



20. The apparatus of 
variance of a smooth gray 
accumulator array. 



Claim 12 wherein a pixel is selected which combines a low 
evel with a favorable distribution of values in an angle 



12 
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